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(57) ABSTRACT 

System and method for visual and audible communication 
between a central operator and N mobile communicators 
(N=2), including an operator transceiver and interface, 
configured to receive and display, for the operator, visually 
perceptible and audibly perceptible signals from each of the 
mobile communicators. The interface (1) presents an audible 
signal from each communicator as if the audible signal is 
received from a different location relative to the operator and 
(2) allows the operator to select, to assign priority to, and to 
display, the visual signals and the audible signals received 
from a specified communicator. Each communicator has an 
associated signal transmitter that is configured to transmit at 
least one of the visual signal and the audio signal associated 
with the communicator, where at least one of the signal 
transmitters includes at least one sensor that senses and 
transmits a sensor value representing a selected environ- 
mental or physiological parameter associated with the com- 
municator. 

12 Claims, 9 Drawing Sheets 
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Basic System Overview Diagram 
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Primary Communicaton Diagram 



FIG. 2 
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Sensor Package System 


FIG. 3 











Audio Signal Path Diagram 
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FIG. 5 



U.S. Patent May 27, 2008 


Sheet 6 of 9 


US 7,378,963 B1 



Perceived Audio Image 


FIG. 6A 


FIG. 6B 
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FIG. 7 
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RECONFIGURABLE AUDITORY- VISUAL 
DISPLAY 

ORIGIN OF THE INVENTION 

This invention was made, in part, by one or more employ- 
ees of the U.S. government. The U.S. government has the 
right to make, use and/or sell the invention described herein 
without payment of compensation therefor, including but not 
limited to payment of royalties. 

FILED OF THE INVENTION 

This invention relates to analysis and display of signals 
representing location and angular orientation of a human’s 
body. 

BACKGROUND OF THE INVENTION 

In many environments, a central operator communicates 
with, and receives visual signals and/or auditory signals 
from, two or more mobile or non-mobile communicators 
who are responding to, or relaying information on, one or 
more events in the field through a signaling channel asso- 
ciated (only) with that communicator. The event(s) may be 
a medical emergency or hazardous substance release or may 
be associated with continuous monitoring of a non-emer- 
gency situation. The visual and/or auditory signals may be 
displayed through time sharing of the displays received by 
the operator. However, this approach treats all such signals 
substantially equally and does not permit fixing the opera- 
tor’s attention on a display that requires sustained attention 
for an unpredictable time interval. This approach also does 
not permit the operator to quickly (re)direct attention to, and 
assign temporary priority to, two or more communicators, 
out of the sequence set by the time sharing procedure. This 
approach, by itself, does not provide information on the 
present location, present angular orientation and present 
environment of the communicator. 

What is needed is a signal analysis and communication 
system that (1) accepts communication signals from mul- 
tiple signal sources simultaneously, (2) permits a signal 
recipient to assign priority to, or to focus on, a selected audio 
signal source. Preferably, the system should allow determi- 
nation of location and angular orientation of a person 
associated with a signal source and should permit visual, 
audible and/or electronic monitoring of one or more param- 
eters associated with the health or operational fitness of the 
person. The system should also allow easy prioritization of 
a selected individual’s audio and visual communication, 
while allowing other communication channels to be moni- 
tored in the background. 

SUMMARY OF THE INVENTION 

These needs are met by the invention, which provides a 
method and system that allows auditory and visual moni- 
toring of multiple, simultaneous communication channels at 
a centralized command post (“local control center”) with 
enhanced speech intelligibility and ease of monitoring visual 
channels; visual feedback as to which channel(s) has active 
audible communications; and orientation information for 
each of N monitored communicators (NS1). Each moni- 
tored communicator wears a hard hat equipped with lighting 
according to O.S.H. A. regulations, headphone, throat micro- 
phone and visual image transmitter (e.g., a camera). The 
local control center, which may be embodied within a 
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hardened laptop computer or equivalent device, includes 
software for modifying input audio signals via compression 
and binaural (three-dimensional audio) signal processing, 
combining these audio signals with visual video, location, 
5 angular orientation and situational awareness information, 
and presenting the audio signals from perceived locations 
that are spatially separated. 

Each of N communicator channels is assigned an azi- 
muthal angular sector associated with the apparent sound 
10 image perceived through the operator’s headset, where N is 
normally between 2 and 8. Spatial audio filtering, using 
head-related transfer function filters, as described in “Multi- 
channel Spatialization System for Audio Signals” U.S. Pat. 
No. 5,483,623, issued to D. Begault and in D. Begault, 
15 “Three-dimensional Sound for Virtual Reality and Multime- 
dia, Academic Press, 1994, esp. pp. 39-190 (content incor- 
porated by reference herein), can be provided so that this 
signal appears to arrive from a specified location within 
sector number n at the operator’s head, with the sector being 
20 non-overlapping so that the operator can distinguish signals 
“received” in angular sector nl from signals “received” in 
angular sector n2 f£nl), even where signals from two or 
more channels are present. 

In U.S. Pat. No. 5,438,623, head related transfer functions 
25 (“HRTFs”) are measured for each of the left ear and the right 
ear for a given audio signal for selected azimuthal angles 
(e.g., ±60° and ±1 50°) relative to a reference line passing 
through an operators head, for each of a sequence of 
frequencies from 0 Hz to about 16,000 Hz, and a measured 
30 HRTF is formed for each ear. A synthetic HRTF is then 
configured, using a multi-tap, finite impulse response filter 
(e.g., 65 taps) and appropriate time delays, which compares 
as closely as possible to the measured HRTF over the 
frequency range of interest and which is used to “locate” the 
35 virtual source of the audio signal to be perceived by the 
operator. If the operator or an azimuthal angle is changed, 
the measured HRTF and synthetic HRTF must be changed 
accordingly. 

Location and angular orientation of a communicator or 
40 helmet are estimated or otherwise determined using digital 
compass, global positioning system (GPS), general system 
mobile (GSM) or other location system, and are presented to 
the operator. 

The invention creates a multi-model communications 
45 environment that increases the situational awareness for the 
operator (controller). Situational awareness is increased by 
a number of innovations such as spatially separating each 
voice communication channel, allowing a single voice chan- 
nel to be prioritized while still allowing other channels to be 
50 monitored. This allows the controller to view real time video 
from each of the controlled communicators, allowing sensor 
data from these communicators to be electronically collected 
separately, rather than being collected over the voice chan- 
nel. The approach also provides an interface for the operator 
55 to record and transmit event data. In addition, each com- 
munications channel is equipped with a video indicator that 
allows the operator to determine who is speaking and from 
which communication channel the signal is being received. 

Examples of situations in which the invention will be 
60 uniquely useful include the following: 

(1) A local control center in a search and rescue or 
monitoring operation often requires one operator with a 
portable communication device to focus attention simulta- 
neously, both visually and audibly, on as many as four 
65 different personnel at once. The operator must be able to 
focus on a specific communicator without sacrificing active 
monitoring (e.g., in the background) of other communica- 
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tors. By supplying a coordinated spatial display of visual and 
auditory information, greater case of segregation of infor- 
mation (auditory, visual, state situation) may be conveyed. 

(2) In high stress situations, such as search and rescue 
operations, a local controller must be provided with an 
optimal display of information, both visually and audibly, 
concerning both rescue personnel and the surrounding envi- 
ronment, such as a collapsed structure. A local controller 
must frequently act quickly on the basis of available (often 
incomplete) information because of the time-sensitive 
nature of rescue operations. An optimal display must pro- 
vide as much information as the operator can accommodate, 
and as quickly and as unambiguously as possible, in a 
manner that allows selective prioritization of information, as 
required. 

(3) Prior art for portable systems for rescue applications 
utilizes multiple audio communication channels mixed in 
and transmitted through a single channel, without video. The 
communication source (video and audio channels) are not 
prioritized to the operator. Supporting technology developed 
by one of the inventors (Begault., U.S. Pat. No. 5,438,623, 
1995) allows spatialization of signals but does not contain a 
mechanism for prioritization. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 schematically illustrates an operator interface with 
a plurality of communicators according to an embodiment of 
the invention. 

FIG. 2 schematically illustrates operator communication 
with each of several communicators systems. 

FIG. 3 schematically illustrates a communicator sub- 
system. 

FIG. 4 illustrates an audio signal path for an operator 
subsystem. 

FIG. 5 illustrates use of the azimuthal angular sectors. 

FIGS. 6A and 6B illustrate computer screens and per- 
ceived audio images, where no channel is prioritized (6A) 
and where one channel is prioritized (6B). 

FIGS. 7, 8 and 9 illustrate use of at least one RFID, or of 
at least three RFIDs, to determine location or angular 
orientation of a communicator. 

DESCRIPTION OF BEST MODES OF THE 
INVENTION 

FIG. 1 schematically illustrates an operator interface 11 
with several communicators (here, four), spaced apart from 
the operator, according to the invention. The operator inter- 
face 11 includes an operator I/O module 12, connected to a 
wireless, N-channel antenna 13, an optional room audio 
broadcast module 14, and a plurality of video monitors, 15-n 
(n=l, . . . , N; here, N=4), where the monitor 15-n receives 
and displays visual images associated with a helmet 21-n 
worn or carried by communicator no, n. The operator is 
connected to the operator interface by an operator headset 
16, which includes operator headphones 17 and an operator 
microphone 18 that provides broadcast or multi-cast audio 
signals for transmission over the N-channel transmission 
system to one, more or all of the N communicators. Option- 
ally, the operator interface also includes a guest headset 19, 
having headphones only, for use by a guest to monitor, with 
no audible input, audio information received by the operator. 

A communicator helmet 21-n has an associated commu- 
nicator headset 22-n and an associated communicator 
antenna 23-n for communicating, audibly and otherwise, 
with the operator. Optionally, the communicator helmet 21-n 
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also has one or more (preferably, at least three) short- or 
medium range, spaced apart radio frequency identification 
devices (“RFIDs”) 24-n(k) (k=l, . . . , K;K§3), positioned 
on the helmet and/or on the body of the communicator. Each 
5 RFID communicates (one way or two way) with three or 
more spaced apart locator modules 25-m (m=l , 2, 3, ... ) 
that receive RFID signals from each RFID 24-n(k) and that 
estimate, by triangulation, the present location of the RFID, 
as discussed in Appendix 1 . The RFID signals received from 
10 each RFID may be replaced by GPS signals or GSM signals 
received from three or more GPS signal receivers or GSM 
signal receivers, respectively, and the collection of locator 
modules 25-m can be replaced by a collection of GPS 
satellites or by a collection of GSM base stations (now 
15 shown in FIG. 1). In certain hazardous situations, it may be 
preferable to provide periodic information on each of several 
communicator body locations, such as head, both wrists and 
both feet. 

Where the three dimensional location coordinates of the 
20 communicator or of the helmet are to be estimated and 
provided for the operator, use of a single RFID on the 
communicator’s body or helmet may be sufficient. However, 
where the angular orientation of the communicator’s body or 
helmet is also to be estimated and provided for the operator, 
25 preferably at least three spaced apart RFIDs should be 
provided on the communicator’s body or helmet; and angu- 
lar orientation can also be estimated as set forth in Appendix 
1. 

FIG. 2 schematically illustrates a primary system for 
30 audible communication between an operator and a plurality 
N of communicators (here, N=4). Each communicator sub- 
system includes a throat microphone 31-n (n=l, . . . , , N), 
a pre-amplifier 32-n, and an analog-to-digital converter 
(“ADC”) 33-n. The signals issued by a communicator (n) are 
35 received by a plug-in module spatializer 34-n that assigns a 
non-overlapping azimuthal angular sector associated with 
the operator’s headset to each of N communicators, where N 
is normally between 2 and 8. Spatial audio filtering of the 
audio signal received by each of the operator’s two ears from 
40 communicator number n (=1, . . . , N), using a pair of 
head-related transfer function filters that produce the correct 
spectral, phase and intensity cues for a specified auditory 
location, is arranged so that this signal appears to arrive from 
a specified sector number n at the operator’s head. The 
45 sectors are preferably non-overlapping so that the operator 
can distinguish signals “received” is angular sector nl from 
signals “received” in angular sector n2 (Anl), even where 
signals from two or more channels are present. The operator 
can also use voice timbre and linguistic characteristics to 
50 distinguish between signals received in two or more chan- 
nels, substantially simultaneously. 

A “prioritization system” allows a selected channel to be 
brought “front and center” to an unused central angular 
sector in the display, allowing the operator to focus on an 
55 individual communicator while not sacrificing active moni- 
toring of the other communicators. The spatializer output 
signals are received and converted to analog formal by a 
digital-to-analogy converter (“DAC”) 36, with the converted 
signal being received by a headphone amplifier 37 to pro- 
60 vide audibly perceptible signals for the operator 38. 

Optionally, the visual and location/orientation (“L/O”) 
information received from each communicator channel can 
be presented in time sharing mode, where each of the N 
channels receives and uses a time slot or time interval of 
65 fixed or variable length At(n) in a larger time interval of 
length AT (>E„At(n)), where the remaining time, of length 
AT-L n At(n), is reserved for administrative signals and for 
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special or emergency service and/or exception reporting, as 
required by a specified channel, using a prioritization pro- 
cedure for the specified channel. Sensing of a non-normal 
environmental situation at a communicator’s location 
optionally assigns this remainder time (of length AT— Z„At 
(n)) to reporting and display on that channel. Preferably, the 
time interval lengths At(n) should not exceed a temporal 
length that would cause communication through the chan- 
nels to appear non-continuous. The audio signals received 
from a communicator are preferably presented using the 
spatializer, as discussed in the preceding. 

FIG. 3 is a block diagram illustrating combined operation 
of a video/camera system 41 and an operator input system 
45 . Image output signals from the video camera system 41 
are received by a frame grabber 42 and associated image 
recorder 43 . The frame grabber 42 produces an ordered 
sequence of still frames that are received and processed by 
a still frame processor 44 to provide a selected sequence of 
visual images. The operator input system 45 facilitates 
specification of one or more events and associated event 
information contained in an event database 46 . Time interval 
for display of the specified event information are monitored 
by a time controller 47 . 

Still frame images from the still frame processor and 
corresponding event information from the event database 46 25 
are received and combined in an internal display module 51 
and associated processing and recording module 52 . An 
optional external display module 53 receives and displays 
selected images and alphanumeric information from the 
internal display 51 . Selected information from the process- 30 
ing and recording module 52 is received by a rescue sensor 
module 54 , which checks each of a group of situation 
parameters against corresponding event threshold values to 
determine if a “rescue” or emergency situation is present. If 
a rescue or emergency situation is present, an audibly 
perceptible alarm signal and/or visually perceptible alarm 
signal is provided by an alarm module 55 to advise the 
operator (and, optionally, one or more of the communica- 
tors) concerning the situation. Optionally, the alarm signal 
may have two or more associated alarm modes, correspond- 
ing to two or more distinct classes of alarm events. 

A first class of alarm event parameters specifies a maxi- 
mum time interval At(max;m) during which an event (no. m) 
can persist and/or a minimum time interval during which an 
event (no. m) should persist; a range, At(min;m) StSi 45 
At(max;m), is thus specified, where At(min;m) may be 0 or 
At(max;m) may be °°. 

As a first example, the system may specify that, if the 
communicator is substantially motionless and (optionally) 
supine (estimated using knowledge of the communicator’s 50 
angular orientation) for a time interval exceeding 30 sec, a 
communicator-down alarm will be issued. As a second 
example, if the system senses that the communicator has not 
drawn a breath within a preceding time interval of specified 
length (e.g., within the last 45 sec), a communicator-dis- 55 
abled alarm will be issued. 

As a third example, an exposure-versus-time threshold 
curve can be provided for exposure (1) to a specified 
hazardous material (e.g., trichloroethylene or polychlori- 
nated biphenols), (2) to specified energetic particles (e.g., 
alphas, betas, gammas, X-rays, ions or fission fragments) or 
(3) to noise or other sound at or above a specified decibel 
level (e.g., 90 dB and above); and a sensor carried on a 
communicator’s body or helmet can periodically sense (e.g., 
at one-sec intervals) the present concentration or intensity of 
this substance and issue an exposure alarm signal when the 
time-integrated exposure exceeds the threshold value. 
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In addition to environmental parameters, physiological 
parameters, such as heart rate, breathing rate; temperature of 
a selected body component and/or pH of blood or of another 
body fluid, may be measured and compared to a permitted 
5 range for that parameter. 

FIG. 4 is a block diagram illustrating processing of audio 
signals from N channels using a spatializer according to the 
invention. An audio signal AS(n) is received at a receiver 
61-n (n=l, . . . , N) and processed initially by an envelope 
10 follower 62-n to determine a present level or intensity of the 
audio signal. The received signal is also processed by a gain 
module 63-n and a spatial audio filtering module 64-n that 
introduces the correct right ear-left ear audio differences for 
the operator for this channel so that the operator at 70 will 
15 sense that the audio signal AS(n) is “received” within the 
azimuthal angular sector AAS(n). The N azimuthal angular 
sectors AAS(n) are non-overlapping and may have the same 
or (more likely) different angular widths associated with 
each such sector, depending upon operator ear sensitivity, 
20 signal frequencies and other variables. For example, where 
N=8 channels are used, as indicated in FIG. 5, the azimuthal 
angular sectors (0<0<02) might be chosen as 
AAS(n=l): 3O°<0<42°, 

AAS(n=2): 42°<0<64°, 

AAS(n=3): 64°<0<129°, 

AAS(n=4): 129°<0<18O°, 

AAS(n=5): 18O°<0<231° (-18O°<0<-129°), 

AAS(n=6): 231°<0<296° (-129°<0<-64°), 

AAS(n=7): 296°<0<318° (-54°<0<-42°), 

AAS(n=8): 318°<0<335°. (-42°<0<-25°), 

A “front and center” angular sector, defined, for example, by 
-30° (33O°)<0<3O°, is reserved for a channel signal that is 
selected by the operator to be given special prominence. The 
35 sectors need not be symmetric about either 0=0° or about 
0=180° or about any other azimuthal angle. 

FIG. 5 illustrates use of the azimuthal angular sectors 
AAS(n) with N=5 channels, indicating a perceived “source” 
SAS(n) of an audio signal associated with each channel. 
40 Differential spatial audio filtering for channel n=2, for 
example, can be implemented as follows. The distances of 
the perceived source SAS(n=2) from the operator’s left ear 
and from the operator’s right ear and the associated phase 


difference A<|> are estimated by 


4={te+0.5A* s ) 2 +y/} ,/2 , 

(1) 

d R ={ (x s -Q.5Ax s ) 2 +y s 2 } la . 

(2) 

&ty=(d r -d R )tX, 

(3) 


where A is a representative audio wavelength of the per- 
ceived source signal and (x,y)=(±0.5Ax s ,0) are the location 
coordinates of the operator’s right and left ears relative to an 
origin O within the operator’s head. 

FIGS. 6A and 6B illustrate computer screens and per- 
ceived audio images, where no channel is prioritized (9A) 
and where channel number 1 is prioritized (9B). In FIG. 6A, 
no channel is prioritized, and the four channel icons, corre- 
sponding to communicators no. n=l, 2, 3, 4, are located at 
60 four comers of a square, with the center region unoccupied. 
The virtual locations for the four audio signals in FIG. 9A 
correspond approximately to the azimuthal angles 0=-45°, 
445°, -90° and 4-90°, respectively. Where N communicators 
are tracked (N=2-8), the square can be replaced by a polygon 
65 with N sides (an N-gon), with one channel icon located at 
each of the N vertices or adjacent to one of the N sides of 
the polygon. The configuration in FIG. 6A corresponds to an 
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operator facing and communicating with a group of N 
persons, with no one of these persons being given special 
attention. 


Where a single channel (e.g., n=l) is prioritized, the 
channel icon is moved from its non-prioritized location to a 5 
“front and center” location at the center of the screen, as 
illustrated in FIG. 6B. Corresponding to this choice of 
channel priority, the virtual location for the corresponding 
audio signal is preferably moved to a reserved central sector 
(e.g., -25°<0<3O°). Alternatively, the audio signal for the 
prioritized channel can be audibly displayed with either no 
filtering (no gain equalization) or with filtering correspond- 
ing to a virtual location of 0=0°. Where another channel (no. 
n) is chosen for prioritization, the treatment of the virtual 15 
location is analogous. Optionally, the visual signal corre- 
sponding to the prioritized channel can also be displayed on 
the same screen or on a different screen (not shown in FIGS. 

6A and 6B). 


APPENDIX 1 


Development of Location Relations 

Consider a location determination (LD) system having at 25 
least three spaced apart signal receivers 81-k (k=l, . . . , 
K(K§?4) in FIG. 7, each capable of receiving a signal 
transmitted by a signal source 83 and of determining the 
time an location determination (“LD”) signal is received, 
preferably with an associated inaccuracy no more than about 30 
one nanosecond (nsec). The signal receivers 81-k have 
known locations (\ k ,y k ,z k ), preferably but not necessarily 
fixed, in a Cartesian coordinate system, and the source 83 is 
mobile and has unknown coordinates (x,y,z) that may vary 
slowly with time t. Assuming that the LD signal is trans- 35 
mitted by the source 83 at a known or determinable time, 
t=t0, and propagates with velocity c in the ambient medium 
(assumed isotropic), the defining equations for determining 
the coordinates (x,y,z) at a given time t become 

( (x-x k ) 2 +(y-y k ) 2 +(z~z k f } ,l2 =cAt k -b, (Al) 40 


fei-* 2 ) (yt-y 2 ) fei — Z 2 ) cA/, 2 , 

X | 


AD\2t 

U1-X3) (y, -y 3 ) (zi -z 3 ) cA;, 3 , 

y 


A D 13 , 

fe, — x 4 ) (y, - y 4 ) (z,-Z 4 ) cA/ 14 , 

z 


ad 14 , 

fei -x 5 ) fe,-y 5 ) (zi -Z 4 > cAi, 5 , 

b 


A£>i5, 


AD, J = c 2 • (A if - Ar|) /2 - (fe? - 4) + (A - A) + fe? - z|)l/2, (A7- 1) 

AD , 3 = c 2 • (Al 2 - Aff ) /2 - {(Jtf - 4) + (;y 2 - y|) + (z? - z|)}/2, (A7-2) 

AD , 4 = r 2 - (A / 2 - A$)/2 - {fe? - 4 ) + fe? - A) + fe? - 4 ) 1 / 2 . (A7-3) 

AD , 5 = c 2 • (A ; 2 - Ml) /2 - {(*? - 4 ) + (y? - y|) + (z? - z?))/2, (A7-4) 


If, as required here, any three of the receivers are noncolin- 
ear and the five receivers do not lie in a common plane, the 
4x4 matrix in Eq. (A6) has a non-zero determinant and Eq. 
(A6) has a solution (x,y,z,b). 

If K=4, the three relations in Eq. (A4) plus one additional 
relation can determine the unknown values. To develop this 
additional relation, express Eqs. (A4) in matrix form as 


1 

>2 

Q 

1 

w 

TnT 

1 

fs. 

X 


ADn -b‘cAt\ 2 , 

fe,-x 3 ) (y, -y 3 ) (Z 1 -Z 3 ) 

y 

= 

A Du -b-cAt\3, 

fe, - xt) (y, - y 4 ) (z, - za) 

z 


AD\4 — b • cAt\4, 


AD, 2 = c 2 ■ (All ~ A(i)/2 - ((4 ~4) + fei - A) + fe? - 4)1/2. (A9- 1 ) 

AD, 3 = c 2 • (Al 2 - Al|)/2 - 1(4 - 4) + (y, - y?) + (z? - Z 3 2 )}/2, (A9-2) 

AD,4 = C 2 • (Al 2 - All) n - 1(4 - 4) + (y? - A) + fe? - 4 ) 1 / 2 , (A9- 3 ) 


These last relations are inverted to express x, y and z in 
terms of b: 


At k =t k -t0, 

(A2) 


AD\ 2 - b-cAt\ 2 , 
AD 13 - b cAri 3 , 


X 

y 

b=cl. 

(A3) 


AD 14 - b-cAt]4, 

= 

z 


45 


where t* is the time the transmitted LD signal is received by 
the receiver no. k and t is a time shift (unknown, but 
determinable) at the source that is to be compensated. 

By squaring Eq. (Al) for index j and for index k and 
subtracting these two relations from each other, one obtains 
a sequence of K-l independent relations 


fei- *2) (yi-y2) fei-z2) 
fe,- *3) (yi-y3> fei-z 3 ) 
fe, -jc 4 ) (yi-y 4 ) (Z1-Z4) 


A/ -1 


m \ , m \ 2 m ',3 

W?2i W22 W*23 

m 3 , m' 32 m’ 33 


(A 10) 


(All) 


(A 12) 


2x-fe* -x,) + 2y-(y* -y;) + 2z-(z* -Zj)+ (A4) 

1(4 - 4> + <4 - Aj) + fet - $)} = ^ ' < A '? - A '?) “ 2b -ctojk, 

A tjk = A tj - A l k =tj-t t . (A5) 


x = m\ 1 (A D\ 2 - b • cAt\ 2 ) + 


(A13-1) 


- b-cAt\i) + m\ 2 (AD ]4 -b-cAt] 4 ), 


y = m 2 i(.ADi 2 -b‘cAt\ 2 )+ (A 13- 2) 

m2 2 (AOi3 - b ' cAt\s) + m^ 3 (AD\4 -b-cAtw), 


Equations (A4) may be expressed as K-l linear independent 
relations in the unknown variable values x, y, z and b. 

If KS5, any four of these K-l relations alone suffice to 
determine the variable values x, y, z and b. In this instance, 
the four relations in Eq. (A4) for determination of the 65 
location coordinates (x,y,z) and the equivalent time shift 
b=ct can be set forth in matrix form as 


x = m 3 i (AD\ 2 — ib- cA/ 12 ) + (A 13- 3) 

m 32 (ADi 3 - b • cA/ 13 ) + m 3 3 (AD 14 - b • cAf 14 ), 


These expressions for x, y and z in terms of b in Eq. (A 10) 
are inserted into the “square” in Eq. (Al), 




& 


{ (x-Xyf+iy-y^+iz-Zif }={c-At l f-2b. c-Aty+b 2 , 


(A14) 
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to provide a quadratic equation for b. 


Ab 2 -2Bb+C=0, (A 15) 

A={m\ ] Al, 2 +m\ 2 Ali 2 +tn' vi At l4 } 1 A{m‘ 2i Al l2 + 

m 22 A/ j 3 +m '2 13 Af M } 2 -r- { m ' 3 , Al , 2 im ' 32 A/ ]3 + 5 

m2 13 Ar 14 } 2 , * ‘ ‘ (A 16-1) 

fi=im’ n AD 12 +»i’i 2 AD 13 +m' 13 AD, 4 -j: 1 Hm' n Al 12 + 

m’i 2 ^i3 + ni' l3 &l 1A }+{m\ l AD 12 +m\ 2 AD l2 + 

’n\ 1 AD I/r y 1 }\m\ I Al 12 +m\ 2 At t ,+m\ 1 Al I4 \+ 
\m' u AD l2 +m\ 2 AD li +m\,AD l4 -z l Hm' n Ai l2 + 10 

m' 12 A/i3+m'| 3 A/ !4 }, (A16-2) 

C={m' u AD l2 +m\ 2 AD^m\ 3 AD l4 -x^ ) 2 + 

{ til 2 ] AD ^ 2 + tit 22 AZ) 1 2 3 AD 1 4 yd + 
tm'3 1 AD 1 2+m' 32 AD, 3 +m’ 33 AD ]4 -z 1 } 2 , (A16-3) 

15 


The solution b having the smaller magnitude is preferably 
chosen as the solution to be used. Equations (A15) and 
(A13-j) (j=l, 2, 3) provide a solution quadruple (x,y,z,b) for 
K=4. This solution quadruple (x,y,x,b) is exact, does not 
require iterations or other approximations, and can be deter- 20 
mined in one pass. 

This approach can be used, for example, where a short 
range radio frequency identifier device (RFID) or other 
similar signal source provides a signal that is received by 
each of K signal receivers 81-k. The signal source may have 25 
its own power source (e.g., a battery), which must be 
replaced from time to time. 

Alternatively, each of the K (Kg3) signal transceivers 
91-k can serve as an initial signal source, as illustrated in 
FIG. 8. Each initial signal source 91-k emits a signal having 30 
a distinctive feature (e.g., frequency, signal shape, signal 
content, signal duration) at a selected time, t=t, >Jt , and each 
of these signals is received by a target receiver 93 at a 
subsequent time, t=t r *. After a selected non-negative time 
delay of length Al dJ . (SO), the target receiver 93 emits a 35 
(distinctive) return signal, which is received by the trans- 
ceiver 91-k at a final time, t=t /ji ..=t c ^+2(t r yt -t e ^J+At^. The 
time interval length for one-way propagation from the initial 
signal source 21-k to the target receiver 93 is thus 

40 

AA - A/rf,*}/2(l-l , . . . , K), (A17) 

and the time interval At* set forth in Eq. (A 14) can be used 
as discussed in connection with Eqs. (A1)-(A17). However, 
in this alternative, times at the initial signal sources 91-k are 
coordinated, and any constant time shift b at target receiver 45 
93 is irrelevant, because only the lime differences (of lengths 
At r k ) are measured or used to determine the time(s) at which 
the return signal(s) are emitted. Thus, b=0 in this alternative, 
and the relation corresponding to Eq. (A10) (with b=0) 
provides the solution coordinates (x,y,z). 

The method set forth in connection with Eqs. (Al)-(A7-4) 
for KS5 receivers, and the method set forth in connection 
with Eqs. (A1)-(A17) for K=4 receivers, will be referred to 
collectively as a “quadratic analysis process” to determine 
location coordinates (x,y,z) and equivalent time shift b for a 55 
mobile object or Carrier. 

Determination of Spatial Orientation Relations 

The preceding determines location of a single (target) 
receiver that may be carried on a person or other mobile 60 
object (hereafter referred to as a “Carrier”). Spatial orien- 
tation of the Carrier can be estimated by positioning three or 
more spaced apart, noncollinear target receivers on the 
Carrier and determining the three-dimensional location of 
each target receiver at a selected time, or within a time 65 
interval of small length (e.g., 0.5-5 sec). Where the Carrier 
is a person, the target receivers may, for example, be located 
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on or adjacent to the Carrier’s head or helmet and at two or 
more spaced apart, noncollinear locations on the Carrier’s 
back, shoulders, arms, waist or legs. 

Three spaced apart locations determine a plane n in 
3-space, and this plane n can be determined by a solution 
(a,b,c) of the three relations 

x-cos oc+y-cos P+z-cos y=p, (At 8) 

where a, p and y are direction cosines of a vector V, drawn 
from the coordinate origin to the plane n and perpendicular 
n, and p is a (signed) length of V (W. A. Wilson and J. I. 
Tracey, Analytic Geometry, D. C. Heath publ. Boston, Third 
Ed. 1946, pp. 266-267). Where three noncollinear points, 
having Cartesian coordinates (x^y^z,) (1=1, 2, 3), lie in the 
plane n, these coordinates must satisfy the relations 

jc,-cos ck+Vj-cos afi+z,-cos ay=p, (A19) 

and the following difference equations must hold: 

(jcj-x^-cos a+b^-yiVcos P+(z 2 -Zi)cos y=0. (A20-1) 

0cy-x t )-cos a+(y 3 -yi),-cos p+(z 3 -z,>cos y=0. (A20-2) 

Multiplying Eq. (A20-1) by (z 3 -z,), multiplying Eq. 
(A20-2) by (z 2 -z,), and subtracting the resulting relations 
from each other, one obtains 

{ (z 3 -z i )U 2 ~ X i Mz 2 -z i )U 3 -x , ) }cos a, +{(z 3 — z x )Cy 2 - 

Vi)-(z 2 -2i)(> , 3-y])}cos p=0, (A21) 

The coefficient {(z 3 -z 1 )(y 2 -y 1 )-(z 2 -z J )(y 3 -y,)} of cos P is 
the (signed) area of a parallelogram, rotated to lie in a 
yz-plane and illustrated in FIG. 9, and is non-zero because 
the three points (x f ,y,,z ,) are noncollinear. With z 2 =z, as in 
FIG. 9, the parallelogram area is computed as follows: 

Area = (z 3 - z, )(>’3 - yi ) (A22) 

= to - Zi )(V2 - 36 ) - (z 2 - Zi )(V3 - yi) * 0. 


Equation (21) has a solution 

cos p=-{(z 3 -z,)U 2 -x 1 )-(Z 2 -z 1 )(x 3 -x 1 )}cos a/{(z 3 - 

ZiKyz-yi) -(Z2-Zi)0’3-}’i)l (423) 

Multiplying Eq. (A20-1) by (y 3 -yi), multiplying Eq. (A20- 

2) by (y 2 — y j), and subtracting the resulting relations, one 

obtains by analogy a solution 

cos TF-}(y 3 -yi)(x 2 -Jc,)-<y 2 -yi)(x 3 -x,)}cos a/{(z 3 - 

zi)(y 2 -yi) — (z 2 — z, )(y 3 — y, ) K (A24) 

Utilizing the normalization relation for direction cosines, 

cos 2 a+cos 2 p+cos 2l y=l, (A25) 

one obtains from Eqs. (A23), (A24) and (A25) a solution 

cos a=(±l)/{ 1 +{ (z 3 — Zi )(x 2 -x i )-(z 2 — Zi )U 3 -x i )} 2 /{ 
(z 3 -zi)(y 2 -yi)-(z2-zi)()'3-yi)} 2 +{0’3-yi)te- 
•ti)- 0 ' 2 -yi)(jr 3 -x 1 )}/{(z 3 -z l )Cy 2 -yi)-(z 2 -z 1 )(y 3 - 
y,)} 2 } 1 ' 2 . (A26) 

Equations (A23), (A24) and (A26) provide a solution for the 
direction cosines, cos a, cos p, and cos y, apart from the 
signum in Eq. (A26). The signum (±1) in Eq. (A26) is to be 
chosen to satisfy Eq. (A 18) after the solution is otherwise 
completed. The (signed) length p can be determined form 
Eq. (A18) for, say, (x^yj.Z]). 
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A fourth point, having location coordinates (x,y,z)=(x 4 , 
y 4 ,z 4 ), lies on the same side of the plane id as does the origin 
if 

x,,-cos oc+y 4 cos afl+^cos ay=p a <p, (A27-1) 

lies on the opposite side of the plane Id from the origin if 
x 4 -cos oc+jvcos ap+z^ cos ay=p 4 >p, (A27-2) 

and lies on the plane Id if 10 

x 4 -cos a+v 4 -cos aP+z 4 -cos ay=p 4 =p, (A27-3) 

The fourth point may have location coordinates that initially 
place this point in the plane Id, for example, within a triangle 
Tr initially defined by the other three points (x^y^z,-). As a 15 
result of movement of the Carrier associated with the RFIDs, 
the fourth point may no loner lie in the (displaced) plane Id 
and may lie to one side or to the other side of Id. From this 
movement of the fourth point relative to Id, one infers that 
the Carrier has shifted and/or distorted its position, relative 20 
to its initial position. 

ddie analysis presented here in connection with Eqs. 
(A18)-(A27-3) will be referred to collectively as a “qua- 
dratic orientation analysis process.” 

An initial set of spatial orientation parameters (aO,pO,yO, 25 
pO) may be specified, and corresponding members of a 
subsequent set (a,p,y,p) can be compared with (a(),pO,yO, 
pO) to determine which of these parameters has changed 
substantially. 

As an example, the Carrier may be an ESW, and the initial 30 
plane n may be substantially horizontal, having direction 
cosines cos a=0, cos p=0 and cos y^l (e.g., cos ySO.97). If, 
at a subsequent lime, cos yS0.7 for a substantial time 
interval, corresponding to a Carrier “lean” angle of at least 
45°, relative to a vertical direction, the system may conclude 35 
that the Carrier is no longer erect and may be experiencing 
physical or medical problems. 

As another example, if (aO,po,yO) are substantially 
unchanged from their initial or reference values but the 
parameter p is changing substantially, this indicates that the 40 
Carrie is moving, without substantial change in the initial 
posture of the Carrier. 

What is claimed is: 

1. A system for communication between a central operator 
and a plurality of mobile communicators, the system com- 45 
prising: 

an operator transceiver and interface, configured to 
receive and display, for an operator, visually percep- 
tible and audibly perceptible signals from each of N 
mobile communicators (N=2), numbered n=l, . . . , N, 50 
where the interface (1) presents an audible signal from 
each communicator as if the audible signal is received 
from a different location relative to the operator, (2) 
allows the operator to select, to assign priority to, and 
to display, in a coordinated manner, the visual signals 55 
and the audible signals received from a specified com- 
municator and, (3) associates each of the N communi- 
cators with a separate azimuthal angular sector, deter- 
mined with reference to a selected part of the operator’s 
body, and presents the audible signal from the commu- 60 
nicator as if a source of the audible signal is located at 
the different location within the associated angular 
sector; and 

a signal transmitter associated with each of the N com- 
municators, with each transmitter being configured to 65 
transmit at least one of the visual signal and the audio 
signal associated with the communicator. 
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2 . The system of claim 1 , wherein said environmental 
parameter is drawn from a group of environmental and 
physiological parameters including: length All of a time 
interval during which said communicator has remained 
substantially motionless; length At2 of a time interval during 
which said communicator has remained supine and substan- 
tially motionless; length At3 of a time interval during which 
said communicator has not taken a breath; time integrated 
exposure to a selected chemical in said environment; time- 
integrated exposure to a selected nuclear radiation compo- 
nent in said environment; time-integrated exposure to sound 
at or above a selected decibel rating in said environment, 
heart rate; breathing rate; temperature of a selected body 
component; and pH of a selected body fluid. 

3 . The system of claim 1 , wherein said signal transmitter 
is further configured to sense and transmit at least one of (i) 
location coordinates, in a selected coordinate system, of at 
least one of said communicators and (ii) angular orientation 
coordinates, relative to a selected angular format, of at least 
one of said communicators. 

4. A method for communication between a central opera- 
tor and a plurality of mobile communicators, the method 
comprising: 

providing an operator transceiver and interface, config- 
ured to receive and display, for an operator, visually 
perceptible and audibly perceptible signals from each 
of N mobile communicators (Ng2), numbered n= 
1, .... N, where the interface (1) presents an audible 
signal from each communicator as if the audible signal 
is received from a different location relative to the 
operator, (2) allows the operator to select, to assign 
priority to, and to display, in a coordinated manner, the 
visual signals and the audible signals received from a 
specified communicator and (3) associates each of the 
N communicators with a separate azimuthal angular 
sector, determined with reference to a selected part of 
the operator’s body, and presents the audible signal 
from the communicator as if a source of the audible 
signal is located at the different location within the 
associated angular sector; and 

providing a signal transmitter, associated with each of the 
N communicators and configured to transmit at least 
one of the visual signal and the audio signal associated 
with the communicator. 

5. The method of claim 4, further comprising drawing said 
environmental parameter from a group of environmental 
parameters including: length All of a time interval during 
which said communicator has remained substantially 
motionless; length At2 of a time interval during which said 
communicator has remained supine and substantially 
motionless; length At3 of a time interval during which said 
communicator has not taken a breath; time integrated expo- 
sure to a selected chemical in said environment; time- 
integrated exposure to a selected nuclear radiation compo- 
nent in said environment; time-integrated exposure to sound 
at or above a selected decibel rating in said environment; 
heart rate; breathing rate; temperature of a selected body 
component; and pH of a selected body fluid. 

6 . The method of claim 4, further comprising configuring 
said signal transmitter to sense and transmit at least one of 
(i) location coordinates, in a selected coordinate system, of 
at least one of said communicators and (ii) angular orien- 
tation coordinates, relative to a selected angular format, of at 
least one of said communicators. 

7. A system for communication between a central operator 
and a plurality of mobile communicators, the system com- 
prising: 
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an operator transceiver and interface, configured to 
receive and display, for an operator, visually percep- 
tible and audibly perceptible signals from each of N 
mobile communicators (N§2), numbered n=l, . . . , N, 
where the interface (1) presents an audible signal from 5 
each communicator as if the audible signal is received 
from a different location relative to the operator and (2) 
allows the operator to select, to assign priority to, and 
to display, in a coordinated manner, the visual signals 
and the audible signals received from a specified com- to 
municalor; and 

a signal transmitter associated with each of the N com- 
municators, with each transmitter being configured to 
transmit at least one of the visual signal and the audio 
signal associated with the communicator, wherein at 15 
least one of the signal transmitters comprises at least 
one environmental sensor that senses and transmits a 
sensor value representing a selected environmental 
parameter associated with the communicator; 

wherein at least one of the operator interface and the at 20 
least one environmental sensor compares the environ- 
mental parameter, associated with the communicator 
number n, with a permitted parameter range and issues 
an alarm signal if the environmental parameter value 
does not lie within the permitted parameter range, 25 

wherein (i) the operator receives signals from the N 
communicators on a time shared basis, with signals 
from the communicator number n being received in a 
time interval of length At(n) that does not substantially 
exceed a time interval length associated with a com- 30 
municator number n' (nVn); (ii) for a selected time 
interval length T (T>X„At(n)), a supplemental time 
interval of length AT=T-£„At(n) is reserved and is not 
used by any of the communicators for reporting con- 
ventional information; and (iii) when the environmen- 35 
tal parameter associated with a communicator number 
n" does not lie within the permitted parameter range, at 
least a portion of the supplemental time interval of 
length AT is assigned for receiving signal from the 
communicator number n". 40 

8. The system of claim 7, wherein said environmental 
parameter is drawn from a group of environmental and 
physiological parameters including: length All of a time 
interval during which said communicator has remained 
substantially motionless; length At2 of a time interval during 45 
which said communicator has remained supine and substan- 
tially motionless; length At3 of a time interval during which 
said communicator has not taken a breath; time integrated 
exposure to a selected chemical in said environment; time- 
integrated exposure to a selected nuclear radiation compo- 50 
nent in said environment; time-integrated exposure to sound 

at or above a selected decibel rating in said environment, 
heart rate; breathing rate; temperature of a selected body 
component; and pH of a selected body fluid. 

9. The method of claim 7, wherein said signal transmitter 55 

is further configured to sense and transmit at least one of (i) 
location coordinates, in a selected coordinate system, of at 
lest one of said communicators and (ii) angular orientation 
coordinates, relative to a selected angular format, of at least 
one of said communicators. 60 

10. A method for communication between a central opera- 
tor and a plurality of mobile communicators, the method 
comprising: 
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providing an operator transceiver and interface, config- 
ured to receive and display, for an operator, visually 
perceptible and audibly perceptible signals from each 
of N mobile communicators (NS2), numbered n= 
1, . . . , N, where the interface (1) presents an audible 
signal from each communicator as if the audible signal 
is received from a different location relative to the 
operator and (2) allows the operator to select, to assign 
priority to, and to display, in a coordinated manner the 
visual signals and the audible signal received from a 
specified communicator; and 
providing a signal transmitter, associated with each of the 
N communicators and configured to transmit at least 
one of the visual signal and the audio signal associated 
with the communicator, wherein at least one of the 
signal transmitters comprises at least one environmen- 
tal sensor that senses and transmits a sensor value 
representing a selected environmental parameter asso- 
ciated with the communicator; 
wherein at least one of the operator interface and the at 
least one environmental sensor compares the environ- 
mental parameter, associated with the communicator 
number n, with a permitted parameter range and issues 
an alarm signal if the environmental parameter value 
does not lie within the permitted parameter range, 
wherein (i) the operator receives signals from the N 
communicators on a lime shared basis, with signals 
from the communicator number n being received in a 
time interval of length At(n) that does not substantially 
exceed a time interval length associated with a com- 
municator number n' (n'*n); (ii) for a selected time 
interval length T (T>£„Al(n)), a supplemental time 
interval of length AT=T-Z„At(n) is reserved and is not 
used by any of the communicators for reporting con- 
ventional information; and (iii) when the environmen- 
tal parameter associated with a communicator number 
n" does not lie within the permitted parameter range, at 
least a portion of the supplemental time interval of 
length AT is assigned for receiving signals from the 
communicator number n". 

11. The method of claim 10, further comprising drawing 
said environmental parameter from a group of environmen- 
tal parameters including: length All of a time interval during 
which said communicator has remained substantially 
motionless; length At2 of a time interval during which said 
communicator has remained supine and substantially 
motionless; length At3 of a time interval during which said 
communicator has not taken a breath; lime integrated expo- 
sure to a selected chemical in said environment; time- 
integrated exposure to a selected nuclear radiation compo- 
nent in said environment; time-integrated exposure to sound 
at or above a selected decibel rating in said environment; 
heart rate; breathing rate; temperature of a selected body 
component; and pH of a selected body fluid. 

12. The method of claim 10, further comprising config- 
uring said signal transmitter to sense and transmit at least 
one of (i) location coordinates, in a selected coordinate 
system, of at least one of said communicators and (ii) 
angular orientation coordinates, relative to a selected angu- 
lar format, of at least one of said communicators. 

sj: Jfi ^ 



